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Abstract — A practical constraint that comes in the way of 
spectrum estimation of a continuous time stationary stochastic 
process is the minimum separation between successively observed 
samples of the process. When the underlying process is not 
band-limited, sampling at any uniform rate leads to aliasing, 
while certain stochastic sampling schemes, including Poisson 
process sampling, are rendered infeasible by the constraint of 
minimum separation. It is shown in this paper that, subject 
to this constraint, no point process sampling scheme is alias- 
free for the class of all spectra. It turns out that point process 
sampling under this constraint can be alias-free for band-limited 
spectra. However, the usual construction of a consistent spectrum 
estimator does not work in such a case. Simulations indicate that 
a commonly used estimator, which is consistent in the absence of 
this constraint, performs poorly when the constraint is present. 
These results should help practitioners in rationalizing their 
expectations from point process sampling as far as spectrum 
estimation is concerned, and motivate researchers to look for 
appropriate estimators of bandlimited spectra. 

Index Terms — aliasing, non-uniform sampling, renewal pro- 
cesses, spectral density. 

I. Introduction 

Estimation of the power spectral density of a continuous 
time mean square continuous stationary stochastic process 
is a classical problem HI. Estimates are usually based on 
finitely many observed points. If the spectral density of the 
process is bandlimited (i.e., compactly supported), then one 
can estimate it consistently by using uniformly spaced samples, 
provided the sampling rate is faster than the Nyquist rate 121. 
On the other hand, if the spectral density is not bandlimited, 
then uniform sampling at any sampling rate leads to aliasing, 
i.e., there is a class of continuous processes whose spectral 
densities are indistinguishable from the sampled process. Thus, 
one can not estimate the spectral density of the original process 
consistently on the basis of uniformly spaced samples |3 |. 

In such a situation, non-uniform or irregular sampling 
schemes have been explored. Silverman and Shapiro |3| in- 
troduced a notion of alias-free sampling. Beutler |4| further 
formalized this definition of alias-free sampling for different 
classes of power spectra. Masry |j5| gave another definition of 
alias-free sampling. For each sampling scheme that is alias- 
free according to this definition, he provided a corresponding 
estimator of the spectral density, which would be consistent 
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under certain conditions. Poisson sampling (i.e., sampling at 
the arrival times of a homogeneous Poisson process) turns out 
to be alias-free for the class of all spectra, according to both 
the definitions. 

The existence of consistent estimators in the non- 
bandlimited case makes non-uniform sampling schemes, in 
particular Poisson process sampling, very attractive. However, 
consistency is only a large sample property of an estimator 
Srivastava and Sengupta [61 showed that, if one has the ability 
to sample the process arbitrarily fast, then one can consis- 
tently estimate a non-bandlimited spectral density through 
uniformly spaced samples also, provided the sampling rate 
goes to infinity at a suitable rate as the sample size goes to 
infinity. By comparing the smoothed periodogram estimator 
with the corresponding estimator based on the Poisson process 
sampling, they found that, under certain regularity conditions, 
the rates of convergence for the two estimators are comparable 
and the constants associated with the rates of convergence have 
a trade-off in terms of bias and variance. Thus, the existence 
of a consistent estimator is not an exclusive advantage of point 
process sampling. 

An attractive property of the spectrum estimator based on 
Poisson sampling is that the estimator is consistent for 
any average sampling rate. This property implies that one can 
estimate bandlimited spectra consistently, even if the sampling 
is done at a sub-Nyquist average rate. Such estimators show 
that deficiencies in sampling rate can be made up by sample 
size, provided one is prepared to sample at irregular intervals. 
This fact gives rise to the hope that even when there is a 
constraint on the sampling rate, one can judiciously use non- 
uniform sampling to consistently estimate spectra with much 
larger bandwidth than what can be achieved through uniform 
sampling. 

It is important to note that a small average sampling rate 
does not mean that any two successive samples are far apart. 
In the case of Poisson process sampling with any average 
sampling rate, it can be seen that as the sample size goes 
to infinity, there would be a large number of pairs of con- 
secutive samples which are nearer to each other than any 
specified threshold. Thus, in order to use Poisson process 
sampling with any average sampling rate, sometimes one has 
to sample the process very fast. Many other non-uniform and 
alias-free sampling schemes also have this requirement. All 
these schemes become infeasible if there is a hard limit on 
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the minimum separation between successive samples. Such a 
constraint can arise because of technological limits as well as 
economic considerations. 

Books on sampling JSl, ID give a clear picture of the lim- 
itations of uniform sampling in respect of a constraint on the 
minimum separation between successive samples. However, 
suitability of non-uniform sampling schemes in the presence 
of this constraint has not been studied so far |10|. 

In this paper, we consider the problem of consistent estima- 
tion of the power spectral density of a stationary stochastic 
process through non-uniform sampling, under a constraint 
on the minimum separation between successive samples. In 
Section [III we describe the underlying set-up and discuss 
the notions of aUas-free sampling provided by Shapiro and 
Silverman O as well as by Masry 15]. In section |III1 we 
consider the class of all power spectra, and show that under 
the above constraint, no stationary point process sampling 
scheme is alias-free for this class. Subsequently, we study the 
possibility of alias-free sampling for estimation of spectra that 
are known to be confined to a certain bandwidth. In section HVl 
we discuss the difficulties of obtaining a consistent estimator of 
the power spectrum even when it is known to be bandlimited. 
In Section |Vl we report the results of a simulation study of the 
performance of a commonly used estimator based on Poisson 
process sampling, in the presence of the above constraint. We 
summarize the findings and provide some concluding remarks 
in Section IVll 

II. Notions of Alias-free Sampling 

Let X = {X{t), — oo < t < 00} be a real, mean square 
continuous and wide sense stationary stochastic process with 
mean zero, covariance function C( ) and spectral distribution 
function $(•). If $(•) has a density, we denote it by (/>(•). 
Let T = {tn, n = . . . , —2, —1, 0, 1,2,.. .} be a sequence of 
real-valued, stochastic sampling times. 

Shapiro and Silverman's [3J notion of alias free sampling, 
which was further formalized by Beutler iH, is based on the 
following assumptions about the sampling process. 

Assumption Al. The process t is independent of X. 

Assumption A2. The sequence of sampling times r con- 
stitutes a stationary point process, such that the probability 
distribution of (tm+n ~ ^m) does not depend on m. 

Under a sampling scheme that satisfies properties Al and 
A2, the sampled process Xg — {X{t), t E t} is wide sense 
stationary. Denote the covariance sequence of the sampled 
process X, by i? ={..., r(-2), r(-l), r(0), r(l), r(2), .. .}, 
where 

r{n) = E[X{tm+n)X{trn)], for m, n integers, 

and the expectation is taken without conditioning on the 
sampling times. Beutler's definition of alias-free sampling, 
based on Shapiro and Silverman's earlier idea, is as follows. 



Definition 1. The sampling process t satisfying assumptions 
Al and A2 is alias-free relative to the class of spectra S if 
no two random processes with different spectra belonging to 
§ yield the same covariance sequence (R) of the sampled 
process. 

Shapiro and Silverman ||3l had considered the special case 
where the sampling times constitute a renewal process, and 
§ is the class of all spectra with integrable and square 
integrable densities. They referred to this scheme as additive 
random sampling, and showed that it is alias-free, provided the 
characteristic function of the inter-arrival distribution takes no 
value more than once on the real line. In particular, Poisson 
process (a renewal process having exponentially distributed 
inter-arrival times) sampling scheme is alias-free for the class 
of spectra §. 

The above definition has the drawback that it does not make 
use of the information contained in the sampling times. If one 
wishes to reconstruct </)(•) using a sampling scheme that is 
alias-free according to the above definition, then that would 
be done on the basis of the sequence R only. Beutler |4l 
gave a procedure for this reconstruction, and indicated that this 
procedure may be used to estimate (/)(•) from estimates of R. 
However, Masry ||5l pointed out that the above definition does 
not lead to a spectrum estimator that is provably consistent. 

From all these considerations, this approach appears to be 
rather restrictive. In practice, one would expect to use the 
information contained not only in the sampled values, but 
also in the sampling times, in order to estimate the power 
spectral density. In order to take into account the sampling 
times, Masry Q gave an alternative definition of alias-free 
sampling, while making Assumption Al and the following 
additional assumption about the sampling process. 

Assumption A3. The process r constitutes a stationary 
orderly second-order point process on the real line. 

Let (3 be the mean intensity and fic be the reduced covari- 
ance measure of the process t, and B be the Borel cr-field on 
the real line. Consider the compound process {Z{B), _B G B} 
defined by 

Z{B) = ^ X{U). 

t,eB 

The process Z = {Z{B), i? G B} is second order stationary 
(i.e., the first and second moments of Z{B + t), for any real 
number t, does not depend of t). Let /i^ be the covariance 
measure of the process Z. It can be shown that this measure 
is given by 

fi,{B)^ [ Ciu)[p^du + iicidu)]. (ILl) 
Masry's notion of alias-free sampling is as follows. 
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Definition 2. The sampling process t satisfying assumptions 
Al and A3 is alias-free relative to the class of spectra S if 
no two random processes with different spectra belonging to 
S yield the same covariance measure (/iz) of the compound 
process. 

Note that this definition makes use of the information 
contained in the sampling times, as the covariance measure //^ 
involves the mean intensity /3 as well as the reduced covariance 
measure fic of the sampling process. It has been shown that, 
according to Definition 2, Poisson process sampling is alias- 
free for the class of all spectra having integrable and square 
integrable densities 151. 

III. Sampling under Constraint 

As mentioned in Section U the focus of the present work 
is on a sampling process r which satisfies the following 
constraint. 

Assumption A4. The time separation between two succes- 
sive sample points is at least d (i.e., tn+i — tn > d for any 
index n) for some fixed d > 0. 

In this section, we investigate whether a sampling scheme 
satisfying this constraint can be alias-free. 

A. General spectra 

We present some negative results in the case when § is the 
class of all spectra - bandlimited or otherwise. 

Tlieorem 1. No sampling point process satisfying Assump- 
tions Al, A2 and A4 is alias-free according to Definition 1, 
for the class of all spectra. 

Tlieorem 2. No sampling point process satisfying Assump- 
tions Al, A3 and A4 is alias-free according to Definition 2, 
for the class of aU spectra. 

We prove these theorems in the appendix by constructing 
counter-examples, based on the following class of power 
spectral densities. 



0(A)e**^dA = for \t\ > d. 



(III.l) 



The members of this class correspond to covariance functions 
supported over the interval [—d, d]. A member of this class is 
the power spectral density defined by 

1 1 - cos(qA) 

0a A = , 

na A^ 

for any arbitrary positive a e {0,d]. This density corresponds 
to the covariance function 



Ca{t) 



1 - 1^ for lil < a. 







for \t\ > a. 



Some other members of A can be constructed by convolving 
(pai') with an arbitrary power spectral density. We show in 
the appendix that if Xi, and X3 are independent mean 
square continuous stochastic processes such that X2 and X^ 
have spectra in A and have the same variance, then the spectra 
of Xi + X2 and Xi + X^ cannot be distinguished from the 
sequence R or the measure jjLz, leading to aliasing according 
to Definitions 1 and 2. 

One can easily construct two integrable and square inte- 
grable power spectral densities that are indistinguishable from 
R or Therefore, the statements of Theorems 1 and 2 
also hold in respect of all spectra having integrable and 
square integrable densities (rather than all spectra). Thus, the 
alias-free property of Poisson process sampling mentioned in 
Section Ullbecome inapplicable, once the inter-sample spacings 
are adjusted in accordance with the constraint A4. 

These two theorems show that, under the constraint of 
a minimum inter-sample spacing, any point process sam- 
pling scheme would be inadequate for the identification of 
a completely unrestricted power spectral density - according 
to the existing notions of alias-free sampling. If the power 
spectral density of the original continuous time process is not 
identifiable from the sequence R or the covariance measure 
II then one cannot expect to consistently estimate the power 
spectral density on the basis of estimates of either of these. 

Note that the Assumption A4 comes from a practical con- 
sideration, and it is difficult to think of an implementable 
sampling scheme that would not require it (i.e., a scheme that 
can have arbitrarily closely spaced samples). 

It is well known that estimators based on uniformly spaced 
samples, irrespective of the sampling rate, also suffer from the 
limitation of non-identifiability. In fact, it is this limitation of 
uniform sampling that has been historically used as one of the 
major arguments in favor of non-uniform sampling schemes. 
The above theorems show that the same difficulty applies to 
practical non-uniform sampling schemes as well. 

B. Bandlimited Spectra 

In the case of uniform sampling, it is well known that a 
bandlimited process would not lead to aliasing provided that 
the sampling is done at the Nyquist rate or faster On the 
other hand, uniform sampling at any fixed rate would be free 
from the problem of aliasing if and only if the spectrum of 
the continuous time process is known to be confined to an 
appropriate band. This fact, together with the limitation of 
point process sampling in the case of non-bandlimited spectra, 
gives rise to the question: Can point process sampling under 
Assumption A4 be alias-free for the class of bandlimited 
spectra? If so, it would be interesting to compare the maximum 
allowable spectral bandwidths for alias-free sampling, arising 
from uniform and point process sampling schemes under 
Assumption A4. 
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Fig. 1. Graph of /'(A) on the complex plane for the left truncated exponential 
distribution, with mean 2c! and truncation point d, for — 7r/ii<A<7r/d. 



Fig. 2. Graph of /'(A) on the complex plane for the example given in the 
proof of Theorem 4, for —l.ln/d < A < l.l7r/d. 



It turns out that alias-free sampling under Assumption A4 is 
possible for an important class of stochastic sampling schemes, 
namely, renewal process sampling. This is a special case of 
point process sampling, which has received much attention 
from researchers Q-ID, ifTTl . Poisson process sampling is a 
further special case of renewal process sampling. However, it 
is an ideal sampling scheme, in contrast with implementable 
schemes that would require Assumption A4. 

The benchmark for the present study would be the fastest 
possible rate of uniform sampling under Assumption A4, 
which is 1/d. Note that uniform sampling at this rate is alias- 
free for the class of spectra supported on [—n/d, n/d]. 

First, we present a general result that would be useful in 
answering the foregoing question, as far as Definition 1 of 
alias-free sampling is concerned. 

Theorem 3. A renewal process sampling scheme satisfying 
Assumptions Al and A2, and having characteristic function of 
the inter-sample spacing denoted by /', is alias-free relative to 
a class of spectra supported on the closed and finite interval 
/ according to Definition 1 if and only if the graph of /'(A) 
on the complex plane, for A £ /, does not divide the complex 
plane. 

Theorem 3 relates the alias-free property of a renewal pro- 
cess sampling scheme to the geometry of the characteristic 
function of the inter-sample spacing. It may be noted that the 
distribution of d + X, where d is fixed and X has the gamma 
distribution with any combination of parameters, does not sat- 
isfy the necessary and sufficient condition given in Theorem 3 
for / = [—Tr/d, Tr/d]. It follows that the corresponding renewal 
process sampling schemes, including the case of inter-sample 
spacing having a left-truncated exponential distribution, are 
not alias-free according to Definition 1, relative to a class of 
spectra limited to the band [—n/djir/d]. The graph of /'(A) 



for the left-truncated exponential distribution with mean 2d 
and truncation point d, for —n/d < A < tt/c?, is shown in 
Figure 1 . For such sampling schemes, aliasing can be avoided 
only if the continuous time process is confined to a bandwidth 
that is even smaller than the maximum allowable bandwidth 
in the case of uniform sampling. 

However, there are some other renewal process sampling 
schemes that satisfy Assumption A4 and are alias-free for the 
class of spectra limited to a band larger than [— 7r/d, Tr/d], as 
the next theorem shows. 

Theorem 4. There exists a closed and finite interval /, which 
contains the interval [— 7r/d, Tr/d], and a renewal process sam- 
pling scheme satisfying Assumptions Al, A3 and A4 which 
is alias-free relative to the class of spectra supported on /, 
according to Definition 1. 

The proof of Theorem 4, given in the appendix, invokes 
an example, for which / is more than 10% larger than the 
interval [— Tr/d. vr/d], while the average inter-sample spacing 
is about 35% more than the minimum allowable spacing (d). 
The graph of /'(A) for this inter-sample spacing distribution, 
for — l.lTr/d < A < l.lTr/d, is shown in Figure 2. 

We now turn to Definition 2. Since this notion of alias-free 
sampling is weaker than that of Definition 1, one can expect 
a stronger result. 

Theorem 5. Any renewal process sampling scheme, satisfying 
Assumptions Al, A3 and A4 and the further assumption that 
the inter-sample spacing distribution has a density that is 
positive over a semi-infinite interval, is alias-free according 
to Definition 2, for the class of spectra Umited to the band 
[— Ao, Ao] for every finite Aq > 0. 

Theorem 5 shows that, under the constraint of a minimum 
allowable separation between successive samples, renewal 
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process sampling is alias-free (according to Definition 2) for 
a wider range of power spectra than uniform sampling. It 
is interesting to note that sampling schemes following the 
assumptions of Theorem 5 are alias-free according to Defini- 
tion 2 when the spectral density of the underlying continuous- 
time process is known to be confined to any finite bandwidth 
(no matter how large), but according to Theorem 2, these are 
not alias-free when the process is non-bandlimited. 

It transpires from the foregoing discussion that there are 
contrasting scopes of alias-free renewal process sampling 
under the constraint of a minimum allowable inter-sample 
spacing, according to Definitions 1 and 2. The limited scope 
of alias-free sampling in the case of Definition 1 stems from 
the fact that, under that notion, one aims to identify spectra 
solely from the sequence R, which is rather restrictive. 

IV. Difficulties in estimation of bandlimited 
Spectrum 

Consider a class of spectra having density supported on the 
closed and finite interval /. Given a sampling scheme that is 
alias-free relative to this class according to Definition 1, one 
would look for an estimate of the power spectral density based 
on estimated values of the sequence R. Beutler Q outlined a 
method of estimation based on the representation 

n 

$(Ao) - lim Vcfe„r(7i), (IV.l) 

n— >oo ^ — ^ 

k=l 

for a continuity point Aq of the spectral distribution function, 
where Ckn, k = l,...,n are the coefficients such that the 
uniform convergence of the sequence of partial sums 

n 

lim ^Cfe„/^(A) = l{(-oo,A„)n/}(A) (IV.2) 

fe=l 

happens everywhere except perhaps at Aq. Here, for k = 
1,2,..., /fe(A) is the characteristic function of the distribu- 
tion of the spacing between k successive samples. Note that 
the representation ( IIV.2I ) is possible whenever the sampling 
scheme is alias-free according to Definition 1 Q. 

One can estimate the spectral distribution <&(•) by plugging 
in the estimate of r{n) in (IIV.lt , and can subsequently obtain 
an estimator of the spectral density </)(•). The coefficients Ckn 
defined by ( IIV.2I I. however, are attributes of the sampling 
scheme, and these have to be computed theoretically. For 
the example constructed in the proof of Theorem 4, the 
characteristic function happens to be 

fkiX) = [0.68e*^'^ + 0.32e'2■l^'*]^ 

The coefficients ci„, . . . , c„„ for any fixed n can be obtained 
numerically, either directly from iTV.2\ or by using a Gram- 
Schmidt orthogonalization of the characteristic functions as 
suggested in [5|. There is no closed form solution. In any 
case, the consistency of the plug-in estimator based on dlV It 
has not been proved. 



Theorem 5 gives us a reason to look for estimators of 
(/){■) based on constrained sampling schemes that are alias- 
free for bandlimited processes according to Definition 2. Such 
an estimator would be based on the measure fi^- It can be 
shown that the power spectral density (/>{■) is related to the 
characteristic functions <j)z and (pc of the measures /i^ and /ic 
defined as 

1 
1 

respectively, through the integral equation 

/oo 
0(A - Lj)M^)dio, (IV3) 
-oo 

provided that the measure /ic is totally finite. Masry ||5l and 
Brillinger [12] gave a unique and explicit solution to (IIV.3l l 
under the following additional assumption about the sampling 
process r. 

Assumption Bl. The reduced covariance measure /i^ has the 
density /c( ) satisfying the conditions 

(i) fc{u) +13^ >0 for all u G (-oo, oo); 

(ii) ( {^\"^fl2 is integrable. 

Masry |5| also showed that an empirical version of this 
solution is a consistent estimator of (j>{-). 

Note that, in the case of renewal processes, (/c(-) + (3"^)/ (3 
is the renewal density. Under Assumption A4, this density 
would be necessarily zero over the interval [— d, d]. Therefore, 
Assumption Bl is violated, and the solution to ( IIV.3I ), given in 
121, lfT2l . is not applicable to the present situation. No explicit 
solution is available in general. Consequently, there is no scope 
of using Masry's plug-in estimator 

It emerges from this discussion that all the estimators of a 
bandlimited power spectral density, which have been proposed 
so far on the basis of renewal process sampling, are either 
inapplicable in the present context, or cannot be shown to be 
consistent. 

In summary, even though renewal process sampling, subject 
to the constraint of a minimum inter-sample spacing, is alias- 
free for bandlimited power spectral densities, there is no 
estimator in the literature that is known to be consistent. One 
has to look for new estimators that may be appropriate in this 
situation. 

V. Simulation 

The foregoing discussion leads us to an interesting question: 
How would the available estimators perform under the con- 
straint of a minimum inter-sample spacing? The performance 
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of various estimators based on uniform sampling have been 
studied both theoretically and empirically, and their limitations 
arising from aliasing have been exposed. In this section, we 
consider the performance of a well-known estimator based 
on non-uniform sampling, under the constraint of a minimum 
inter-sample spacing. 

We consider a continuous time stationary stochastic process 
X with mean and power spectral density (f){-) given by 



m = 



2V2 ^4g-8(4A-3ir)V7r + 3g-9(4A-77r) V2;r^ 







if -27r < A < 27r, 
otherwise. 



We consider sampling with a stationary renewal process r 
whose inter-sample spacing is distributed as d + T, where 
the random variable T has the exponential distribution with 
mean 6. Note that for d — 0, this sampling scheme reduces 
to Poisson sampling. We assume that 7i consecutive samples, 
denoted by X (ti) , X (12) , ■ ■ ■ , X{tn) are available for estima- 
tion. 

An estimator of the power spectral density based on the 
above data, which is consistent in the special case d = 0, is 
given as follows. 



n — 1 71— m 



m—l k—1 

W {b„(tk+m - tk)) COS {X{tk+„i - tk)) ; 



(V.l) 



where w(-) is a co variance averaging kernel, and 6„ is the 
bandwidth of the kernel. Note that this is the estimator 
proposed by Masry ||5], which is an empirical version of the 
solution to ( IIV.3I 1 if one assumes d — Q (that is, disregards the 
constraint A4). 

We study the performance of the estimator, 0„( ) for the 
choices 

n = 1000, 
bn = 1/50 



and wix) = 



i{l + cos(7ra;)} if -1 < a; < 1, 
otherwise. 



under the constraint A4. 

We first investigate how this estimator performs when d > 0. 
We conduct multiple simulation runs for each of the choices 
d — 0, 0.5, 1, 2, 4 and 8, together with 6 — 1. Figure 3 shows 
spectrum estimates from five typical simulation runs, along 
with the true power spectral density. The plots show how the 
estimator begins to perform poorly as one moves away from 
d — 0. For larger values of d, the inter-sample spacing is 
dominated by the constant part. Therefore, the sampled data 
resemble that from uniform sampling, which have the problem 
of aliasing. As a result, for larger values of d, spurious peaks in 
greater numbers begin to show in the estimates. The estimator 
also assumes larger negative values when d is larger. 



Figure 4 shows the mean squared error (in log-scale) of 
the estimate computed in each of the above cases from 500 
simulated runs, along with the squared power spectral density. 
It is clear that the mean squared error around the peaks of the 
power spectral density are of the same order as the squared 
power spectral density, and the mean squared error around the 
valleys are much larger for d > than for d = 0. 

This simulation study indicates that the estimator, which is 
consistent in the absence of the constraint on the minimum 
inter-sample spacing, can perform poorly in the presence of 
the constraint. 

The next question we try to answer is: Given the constraint 
d = 1 (so that uniform sampling at any sampling rate would 
necessarily lead to aliasing), is there an appropriate choice 
of 9 that would produce a reasonable estimate of the power 
spectral density? In order to answer this question, we again 
run multiple simulations for 9 = 0, 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 
10 and 20. In Figure 5, we present spectrum estimates from 
five typical simulation runs in each of these cases, together 
with the true power spectral density. For 6 = 0, i.e., the 
case of uniform sampling at sub-Nyquist rate, there is clear 
evidence of spurious peaks in the spectrum estimates. A similar 
occurrence is observed for small positive values of 6. On the 
other hand, large values of 6 give rise to large variability in 
the estimates. 

Figure 6 shows mean squared errors (in log scale) of the 
estimates computed in each of the above cases from 500 
simulated runs, along with the squared power spectral density. 
It transpires that irrespective of the trade-off between bias 
and variance observed in Figure 5, the mean squared errors 
in all the cases are comparable. The mean squared error is 
of the order of the squared value of the true power spectral 
density around the peaks, and several orders of magnitude 
larger around the valleys. 

These findings indicate that the estimator ( IV. Il l does not 
perform well for any choice of 6. 

VI. Concluding remarks 

The constraint of a specified minimum inter-sample spacing 
is a natural one, in view of technological and economic con- 
straints. We have come across some interesting findings after 
formally incorporating this constraint in the study of aliasing 
in the context of spectrum estimation. The most important 
finding is that under this constraint, no point process sampling 
scheme is alias-free for the class of all spectra - according to 
any definition. It should be noted that the possibility of alias- 
free sampling, leading to consistent estimation of the power 
spectral density, has traditionally been a major argument in 
favour of point process sampling (in contrast with uniform 
sampling). This argument does not hold at all in the presence 
of the above constraint. 

We have shown in Section |lll] that when the inter-sample 
spacing is constrained to be larger than a threshold, renewal 
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Fig. 3. Estimates of the power spectral density for 8 = 1 and different values of d. The bold line represents the true power spectral density, while the thinner 
lines represent five typical estimates. 




Frequency 



Fig. 4. Plot of the true squared power spectral density and the mean squared en'ors of spectrum estimates (in log scale) based on 500 simulation runs for 
9 = 1 and different values of d. 
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Fig. 5. Estimates of tiie power spectral density for d = 1 and different values of 6. The bold line represents the true power spectral density, while the thinner 
lines represent five typical estimates. 
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process sampling schemes are alias-free for suitably bandlim- 
ited spectra according to Definition 1 . The range of bandwidths 
for alias-free renewal process sampling for some inter-sample 
spacing distributions is smaller than the corresponding range 
for regular sampling, while it is larger for some other dis- 
tributions. On the other hand, according to Definition 2, all 
renewal process samplings schemes satisfying the conditions 
of Theorem 5 are alias-free for the class of spectra limited to 
any finite band. 

Masry [SJ pointed out that the plug-in estimator suggested 
by Beutler H is not provably consistent, and provided another 
estimator which is consistent under certain conditions. The 
discussion of Section |IV] shows that these conditions do not 
hold under the constraint considered in this paper - even when 
the power spectrum is known to be bandlimited. This brings 
us back to square one as far as estimation of power spectral 
density is concerned. Since the standard methods would not 
work well in the presence of the constraint, as demonstrated 
through the simulations of Section [Vl there is ample scope for 
further research in the area of estimation. 

Appendix 

Proof of Theorem 1. Consider independent, zero mean, 
mean square continuous stationary stochastic processes Xi, 
X2 and X3, having covariance functions Ci{-), i — 1,2,3, 
respectively, such that C2(0) — CsiO) and X2 and X^ 
have different spectral densities belonging to the class A 
defined in dlll.ll ). Consider a sampling point process t = 
{tn, n = ...,—2,-1,0,1,2,...} satisfying the Assump- 
tions Al, A2 and A4. Let the processes Xi + X2 and 
Xi + X3 have spectral distributions $i2(-) and <i>i3(-), re- 
spectively, and covariance sequences of sampled processes 



R12 = {ri2{n), n = ...,-2,-1,0,1,2,...} and R13 = 
{^isin), n — . . . , —2, —1, 0, 1,2,.. .}, respectively. We have 

ri2(0) = Ci(0) + C2(0) = Ci(0) + CsiO) = ri3(0). 

For arbitrary integers m and n, let F„ (x) be the distribution 
function of {tm-^-n — tm). Assumption A4 implies that Fn{x) is 
supported on the interval [\n\d, 00). It follows that, for n ^ 0, 

ri2(n) =E[Xi{t„,+n)Xi{tm)]+E[X2{t„,+n)X2{t„,)] 

/>00 nOO 

= Ci{u)dFn{u)+ C2{u)dFn{u) 
JO Jo 

/* CO /* CO 

= / Ci(u)dF„(u)+ / C2iu)dF,,{u) 

J\n\d J\n\d 

POO 

= / Ci{u)dF,,{u), 

J\n\d 

since C2(-) is supported on [— d, d]. Likewise, ri3(n) is also 
equal to the last expression. This completes the proof. □ 

Proof of Theorem 2. Consider independent, zero mean, 
mean square continuous stationary stochastic processes Xi, 
X2 and X3, having covariance functions Ci( ), i = 1,2,3, 
respectively, such that C2(0) = C3(0) and X2 and X3, have 
different spectral densities belonging to the class A defined 
in (IIII.ll) . Consider a sampling point process r = n — 
...,-2,-1,0,1,2,...} satisfying the Assumptions Al, A3 
and A4, and having mean intensity /3 and reduced covariance 
measure fic- Let the processes Xi + X2 and Xi + X3 have 
spectral distributions <i>i2(-) and <i>i3(-), respectively. As in 
Section [III consider the compound processes 

Zij = I Zij{B) = J2 MU) + XjiU), S e B I , J = 2,3, 
I ties J 
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which have covariance measures /i^^g given by 



{Ci{u) + Cj{u)} [fi'^du + Mc(du)], J = 2,3, 



respectively. 

The reduced covariance measure /ic of the point process t 
can be expressed as 

= I35q{B) +P [ [dK{u) - S e B, 

JB 

where 

oo 

K{u) = Y.P,A\u\\ 

n=l 

Fn{u) is the conditional probability 

Fn{u) = limP [N{t, t + u]>n\ N{t - e, i] > l] , 

and {N{B), B G M} is the counting process induced by the 
process t ifTSl . lfT4l . Assumption A4 implies that K{u) = 
for u £ [— d, d]. 

It follows from the above representation of fic that, for each 
Borel set B, the covariance measures /i^^^ is given by 

C2iu)[P^du + ficidu)] 

lBn[-dM] 

^ [ Ci{u)[l3^du + Hc{du)] 

J B 

+ /?C2(0)(5o(sn 

Since C2(0) — 6*3(0), it is clear that the measures fi^^^ and 
/izi3 agree on all Borel sets. This completes the proof. □ 

Proof of Theorem 3. Here, the sampling process t = 
{t„, n — . . . . —2. —1, 0, 1,2,.. .} is such that the inter-sample 
spacing tn+i ~tn for different values of n are independent and 
identically distributed, say with distribution function F{-). 

Let § be the class of spectra supported on the closed and 
finite interval /. Let X be a process as defined in the theorem, 
and have the power spectral distribution <&(•) belonging to §. 
The covariance sequence R of the sampled process is given 
by 

r{n) —E[X [tjyi+n 

=E [E[X{t^+n)X{Un) I r]] 

' 1 



--E 



2tt 



d$(A) 



The interchange of the integration is possible by Fubini's 
theorem, since the power spectral distribution $(•) and the 
probability distribution of tm+n — tm are both finite. Since the 



latter distribution is the n-fold convolution of the inter-sample 
spacing distribution, we have 



1 



27r 



r{n)^- / [nX)Td^{\), 



(A.l) 



where /'(•) is the characteristic function of inter-sample spac- 
ing distribution, i.e., 

1*00 

/'(A) / e'^ydF{y), -cx)< A < cx). 

The sampling scheme t is alias-free relative to the class 
of spectra § according to Definition 1, if no two different 
spectra $1 and $2 belonging to S produce the same covariance 
sequence R. Since the sequence R satisfies r{~n) — r(n), the 
foregoing condition is equivalent to the statement: 

^[/'(A)]"(d$i(A) - rf$2(A)) = for n = 0, 1, 2, . . . 

implies that $i(-) = $2(-)- 

(A.2) 

The above integral with respect to the real variable A can be 
written as a complex integral over the contour 

n = {z: z = /'(A), A e /}. (A.3) 

Thus, we can conclude that the sampling scheme r is alias 
free relative to the class of spectra § according to Definition 1 
if and only if 

For any signed measure 1/ defined on the 

Borel cr-field on fi. 



/ z'^v{dz) = for n = 0, 1,2, , 



(A.4) 



0. 



Note that, since VI is the image of the continuous function 
/'(A) on the closed and finite interval /, the contour Vl is 
compact. Let C{Vt) be the Banach space of all complex-valued 
continuous functions on VI equipped with the supremum norm. 
Let M be the set of all signed measures defined on the Borel cr- 
field on VL. For any e M, define the complex valued bounded 
linear functional L^, defined on C(il) as 

L^{g) = I g{z)v{dz) for all g e C{n). (A.5) 
Jn 



In terms of these notations, we rewrite iAAi as 

for any 1^ eU, = for n = 0, 1, 2, . . . " =^ ly = 0. 

(A.6) 

By the Riesz representation theorem, every bounded linear 
functional L on C(51) can be represented as 

= / g{z)iyi{dz) + i / g{z)v2{dz) for all g G C(r2), 
Jn Jn 

_ (A.7) 

for a unique pair of measures vi and 1^2 in M |15|. It follows 
that the necessary and sufficient condition (IA.6I 1 is equivalent 
to the condition: 



For any bounded linear functional L on C(fi), 
=0 for n = 0,1,2,..." =^ L = 0. 



(A.8) 
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(A.9) 



The above condition is a statement about the sequence 
{1, z,z'^, . . . ,} in relation to the Banach space C(fi) {p. 257 
of lUll}. By Theorem 11.1.7 of [16J, (IaTSI i is equivalent to 
the condition: 

"The linear span of the sequence {l,z,z^,...,} 

is dense in C(51)." 

The above condition can be rephrased as: "Any g e C{ft) 
can be expanded in a uniformly convergent sequence of 
polynomials." By a result of |17| (see also |18|), we get the 
further equivalent condition: 

"The set fl is nowhere dense and does not divide the plane." 

(A. 10) 

Since the set f2 is a curve in the complex plane, it is always 
a nowhere dense set. This completes the proof. □ 

Proof of Theorem 4. Let / = [-l.l7r/d, l.lvr/d]. Consider 
the two-point discrete distribution F, given by 



for t < d, 
F{t) = < 0.68 for 1 < i < 2. Id, 

1 for t > 2.1. 



(A. 11) 



It follows that the average inter-sample spacing is 1.352d. 
Also, 

/'(A) = 0.68e*^'' + 0.32e'2-i^f 

The plot of the imaginary part of /'(A) against the real part, 
for A e /, is given in Figure 2. It can be verified that the 
graph does not divide the complex plane. The result follows 
from Theorem 3. □ 

Proof of Theorem 5. Here, the sampling process t = 
{tn, n — . . . , —2, —1, 0, 1,2,.. .} is such that the inter-sample 
spacing i„+i — f„ for different values of n are independent and 
identically distributed having probability density function /(•). 
Let f3 and /ic be the mean intensity and the reduced covariance 
measure, respectively, of the process r. The measure /^c can 
be expressed as 

fic{B) /3(5o(B)+ / I3[h{u)-/3]du for each B e B, (A.12) 

where h{u) is the renewal density function, i.e. 



Note that Assumption A4 implies that /(■) is supported on 
[d, oo), and so h{-) is supported on (— oo, d] U [d, oo). Let us 
assume, without loss of generality, that f{u) > for u > Id 
for some Z > 1. 

Let § be the class of bandlimited spectra supported on 
[— Ao,Ao]. If the sampling scheme r is not alias-free relative 
to the class of spectra §, then there exist two zero mean, mean 
square continuous stationary stochastic processes Xi and X2 



with different power spectral distributions $i( ) and ^2{-) 
such that compound processes 



[ t.eB ) 



J = 1,2, 



have the covariance measures fi^i and /i^^, respectively, sat- 
isfying fizi = fJ'Z2- Here, for i? e B, the covariance measures 
are given by (see dll.ll ) and ( |A.12| |) 



= (3Cj{0)SoiB) + p / C,{u)h{u)du, j - 1, 2, 

JB 

where Ci(-) and C2{-) are the covariance functions of the 
processes Xi and X2 respectively. In order that the covariance 
measures /i^^ and fj,z2 ^re the same, the point masses at zero, 
as well as the absolutely continuous parts, must agree. The 
equality of the point masses requires 



Ci(0) = C2(0). 



(A.13) 



On the other hand, equality of the absolutely continuous parts 
means 

Ci(u)h(u) — C2{u)h{u) for — 00 < u < 00. 

Since h{u) > for the \u\ > Id, we have 

Ci{u) = C2iu) for \u\ > Id. (A. 14) 

If the processes Xi and X2 have spectra limited to the band 
[— Ao, Ao], then the covariance function Cj(-) for j = 1,2 can 
be expressed as lfT9l 



C. 



^ 00 

{u)^- J2 C,{nT)^mc(^^{u-nT)), (A.15) 



where T = and 



2Ao 



sine (a;) 



if x ^ 0, 
1 if a; = 0. 



Let k = [Id/T], where [u] represents the integer part of the 
real number u. It follows from ( |A.13l l-( |A.15l ) that 



Ci{u)~C2{u) 

k 

= J2 {Ci{nT)-C2{nT)} sine (^^{u-nT) 

n— — k 

+ {CiW - C2inT)} sine (^(m - nT) 

\n\>k 

k 

= Y,{C,{nT) - C2{nT)] 
=1 

(sine (^^{u - nT)^ + sine (^^{u + nT))) . 



X 
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By using the fact that sm{kTT + 9) = (—1)'^ sin6' for all integer 
k, we have for a ^ u/T - [u/T] > 0, 

Ci{u)-C2{u) 



k 



= > JCi(nr)-C2(nT)} 

sin { (—71 + [^] ) TT + QfTr} sin {(n + [^] ) vr + a7r} 



n=l 



f (u - nT) 



sin(a7r) 



k 

E 

n=l 



(-1)- 



("ir 



^{u-nT) ^{u + nT) 
Since (—1)" = (—1)^" for each integer n, we have 

Ci{u)-C2{u) 



^[(-l)"{Ci(nr)-C2(nr)}]^ 



2T2' 



Let w„ = [(-l)"{Ci(nT) - CslnT)}]. In view of dXTl) . the 
above equation implies that 

A: 



E 



= 0, 



(A. 16) 



for u e {(Zd, (fc + 1)T)} U {u-^,+i(mT, (m + l)r)}. 

Note that the function on the left hand side of ( IA.I6I 1 is 
a ratio of polynomials. The polynomial in the numerator has 
degree 2k — 2, while the denominator is bounded over the 
domain of the function. Thus, the ratio of the polynomials 
can be zero at most at 2A: — 2 points. Therefore, the fact that 
this function assumes the value everywhere on the interval 
{{k + 1)T, (fc + 2)T) implies that the polynomial in the 
numerator is identically equal to zero. Thus, the ratio of the 
polynomials is identically zero. Hence, 



k 



= 0, for ue \J {mT, (m + 1)T). 



n— 1 ^ " 711—0 

By considering the limit of the left hand side as w J, nT, it is 
found that Vn ~ for n = 1, . . . , fc, that is, 

Ci(nT) = C2(nT) for |n| = 1, . . . , fc. 

According to (IA.13b . the above equality holds for n — 0, while 
(IA.15b and (IA.14I I imply that it holds for \n\ = fc + 1, fc + 2, . . .. 
Thus, Ci{nT) = C2{nT) for all n. It follows from ( |AJ3] i that 
Ci{u) = C2{u) for each u, which contradicts the assumption 
that Ci and C2 are different. So the sampling scheme t is 
alias-free for the class of the spectra S. □ 
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